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(N 

^.^' Abstract. Let V be a quadratic space with a form q over an arbitrary local 

J^ ' field F of characteristic different from 2. Let W = V (B Fe with the form Q 

extending q with Q(e) = 1. Consider the standard embedding 0{V) ^^ 0(W) 
and the two-sided action of 0(y) X 0(V) on 0(W). 

In this note we show that any 0{V) X 0(V')-invariant distribution on 0(W) 
is invariant with respect to transposition. This result was earlier proven in a 
bit different form in [^D] for F = R, in |AvD| for F = C and in [g^ for 
p-adic fields. Here we give a different proof. 
P^ ' Using results from IAGS| , we show that this result on invariant distributions 

^^ ' implies that the pair {0{V), 0{W)) is a Gelfand pair. In the archimedean set- 

^^^ ting this means that for any irreducible admissible smooth Frechet representation 

(~| ! (t, F) of 0(W) we have dimiTomo(v)(-E,C) < 1. 

• ^—1 ' A stronger result for p-adic fields is obtained in |AGRS07] . 
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1. Introduction 

Let i^ be a local field of characteristic different from 2. 

Let [W^Q) be a quadratic space defined over F and fix e G M^ a unit vector. 
Consider the quadratic space V = e^ with q = Q\v ■ Define the standard imbedding 
0{V) ^^ 0{W) and consider the two-sided action of 0{V) x 0{V) on 0{W) defined 
by (51,52)^ '■— 9ihg2 ■ We also consider the anti- involution t of Oq given by 
T{g) = g^^. In this paper we prove the following theorem 
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2 AVRAHAM AIZENBUD, DMITRY GOUREVITCH, AND EITAN SAYAG 

Theorem (A). Any 0{V) x 0(V) invariant distribution on O(W^) is invariant 
under r. 

This theorem has the following corollary in representation theory. 

Theorem (B). Let {Tr,E) be an irreducible admissible representation of 0{W). 
Then 

dimHomQiY\{E,C) < 1 

Here admissible representation refers to the usual notion in the non-archimedean 
case and to the notion of admissible smooth Frechet representation in the archimedean 
setting. 

Our proof for the archimedean and non-archimedean case is uniform, except at 
one point where the archimedean case requires an extra analysis of a certain normal 
bundle (see lemma W^ . 

Remark 1.1. We note that a related result for unitary representations of SO{V, Q) 
is proved in |BvDj (for p-adic fields) and in |vD| (for the real numbers). In fact, 
the proof given in those papers implies also theorem A. Also, an analogous theorem 
for unitary groups is proven in |vD2] . 

Acknowledgements. We thank Prof. Gerrit van Dijk for pointing out to us that 
the arguments of jvD], [AvD] and [BvDj give a proof of theorem A. We also thank 
Dr. Sun Binyong for finding a mistake in the previous version of this note. Finally, 
we would like to thank the referee for useful remarks. 

2. From Invariant distributions to Representation theory 

In this section we recall a technique due to Gelfand and Kazhdan which allows 
to deduce theorem B from theorem A. 
Recall the following theorem f [AGSp 

Theorem 2.1. Let H C G be reductive groups and let t be an involutive anti- 
automorphism of G and assume that t{H) = H . Suppose t(T) — T for all bi H- 
invariant distributions\j on G. Then for any irreducible admissible representation 
{tt,E) of G we have 

dimHomH{E,C) ■ dimHomH{E,C) < 1, 
where E denotes the smooth contragredient representation. 

Note that in the non-archimedean case the same result is proven in [Pra| . 
To finish the deduction of theorem B from theorem A we will show that 

Theorem 2.2. Let {tt,E) be an irreducible admissible representation of G = 0{V). 
Then E = E and in particular 

dimHomniE, C) = dimHomi{{E, C) 

For the proof we recall proposition 1.2 (chapter 4) from jMVW] : 

Proposition 2.3. Let V be a quadratic space and let g G 0(V). Then g is conjugate 
tog-\ 



In fact it is enough to check this only for Schwartz distributions. 
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Proof of Theorem \2.SX For non-archimedean fields this is a theorem from |MVW| 
page 91. For archimedean fields we use the Harish-Chandra regularity theorem and 
the proposition that any element in (7 S 0{V) is conjugate in 0{V) to g^^. Thus, 
the characters of E and E are the same and hence E = E. D 

Remark 2.4. A related result for the groups SO{V) can be found in [GPj . propo- 
sition 5.3. 

3. Basic Results on Invariant distributions 

In this paper we consider distributions over ^-spaces and over smooth manifolds. 
Z-spaces are locally compact totally disconnected topological spaces (see |BZ] . sec- 
tion 1). 

For X a smooth manifold or an Z-space we denote by 'D{X) the space of distri- 
butions on X . When X is an Z-space this means that 'D{X) = S{X)* where <S'(^) 
is the space of locally constant functions with compact support on X. For smooth 
X,we\etV{X) = C^{X)*. 

The basic tools to study invariant distributions on a G-space X are Bruhat filtra- 
tion, Frobenuis reciprocity ( [BZ| . |Bar| and [AGS] ) and the Bernstein's localization 
principle ([Ber, and |AG| ). Let us remind the statements. 

For the simplicity of formulation we provide, for each principle, two versions: for 
Z-spaces and for smooth manifolds. 

3.1. Bruhat Filtration. Although we will not need the non-archimedean version 
of this principle, we formulate it for completeness. It is a simple consequence of 
proposition 1.8 in |BZj . 

Theorem 3.1. Let an l-group G act on an l-space X. Let X = Ui=o -^j ^^ ^ ^~ 
invariant stratification of X . Letx be « character of G . Suppose thafD^Xi) '^ = 0. 
Then I?(X)G'X = 0. 

To formulate the archimedean version we let X be a smooth manifold and Y C X 
a smooth submanifold. We remind the definition of the conormal bundle GNy . For 
this denote by Tx the tangent bundle of X and by Ny := {Tx\y)/Ty the normal 
bundle to Y in X. The conormal bundle is defined by GNy := (Ny)*. Denote by 
Sym^{GNy) the k-th symmetric power of the conormal bundle. 

Theorem 3.2. Let a real reductive group G act on a smooth affine real algebraic 
variety X. Let X — IJj^q ^i be a smooth G-invariant stratification of X. Let x be 
an algebraic character of G. Suppose that for any k G Z>o and any < i < I we 
have V{X„ Sym^{GN^^))^-^ = 0. Then V{X)^-^ = 0. ~ 

For proof see |AGS| . section B.2. 

3.2. Probenius reciprocity. For Z-space, the following version of Frobenius reci- 
procity is proven in [Berj : 

Theorem 3.3 (Frobenius reciprocity). Let a unimodular l-group G act transitively 
on an l-space Z . Let Lp : X ^> Z he a G-equivariant continuous map. Let z Cz Z . 
Suppose that its stabilizer Stahciz) is unimodular. Let X^ be the fiber of z. Let x 
be a character of G. Then T>{X)'^'^ is canonically isomorphic to T>{Xzy'^^'^^^>'^. 

An archimedean version is considered in [Bar) . Here is a slight generalization 
(see [AGS]): 
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Theorem 3.4 (Frobenius reciprocity). Let a unimodular Lie group G act transi- 
tively on a smooth manifold Z. Let tp : X —f Z be a G-equivariant smooth map. 
Let z ^ Z. Suppose that its stabilizer St&hG{z) is unimodular. Let X^ be the 
fiber of z. Let x be a character of G. Then T>(X)^'^ is canonically isomorphic to 
I?(X^)^*'''^g(z),x, Moreover, for any G-equivariant bundle E on X, V{X,E)^'^ is 
canonically isomorphic to T>{Xz, E\x^y^^'^^^'''^. 

3.3. Bernstein's Localization principle. For Z-spaces it is taken from jBer] : 

Theorem 3.5 (Localization principle). Let X and T be I -spaces and (f> : X ^ T be 

a continuous map. Let an l-group G act on X preserving the fibers of (p. Let x be a 
character ofG. Suppose that for any t e T, V{(j)-'^(t))^^^ = 0. ThenV{X)^'^ = 0. 

For real smooth algebraic varieties, the following theorem is proven in [AG| . 
Corollary A.0.3: 

Theorem 3.6 (Localization principle). Let a real reductive group G act on a smooth 
affine real algebraic variety X. Let Y be a smooth real algebraic variety and (j) : 
X ^t Y be an algebraic G-invariant submersion. Suppose that for any y ^ Y we 
have P(0-i(y))^'X = 0. Then V(X)^^^ = 0. 

4. Proof of Theorem A 

Recall the setting. {W,Q) is a quadratic space over F, e Q W with Q{e) ~ 1. 
Also (V, q) is defined by F = e-"" and q = Q\v- 
We need some further notations. 

• Oq — 0{V, q) is the group of isometrics of the quadratic space (V, g). 
. Gq^OiV,q)xO{V,q). 

• A:Oq^Gq the diagonal. Hq = A{Oq) C Gq. 

• tJk9i,92) = (ff2,.gi)- _ 

• Gq = Gq yi {1, r}, same for Hq 

• X ■ Gq —> {+1: ^1} the non trivial character with xi^q) — 1. 

• Gq acts on Oq by (51,52)2; = gixg2^ and t{x) — x^-^. 
Clearly Theorem A follows from the following theorem: 

Theorem 4.1. V{Oq)^-"^ = 

4.1. Proof of theorem 14.11 We denote by F = {u; G M^ : Q{w) = 1}. Note that 
by Witt's theorem F is an Oq transitive set and therefore F x F is a transitive Gq 
set where the action of Gq is the standard action on VF © 14^ and r acts by flip. 

Applying Frobenuis reciprocity (|3.31 13. 4p to projections of Oq x F x F first on 
F X F and then on Oq we have 

V{Oq)'^-''^ = 'DiOQ X F X TfQ^^ 
and also that 

V{Oq X F X F)^'X == P(F X F)^^'^ 
In what follows we will abuse notation and write Q{u,v) for the bilinear form 
defined by Q. Define a map Z? : F x F ^ Z where Z ^ {{v,u) eW ®W : Q{v,u) = 
0, Q{v + u) = 4} by 

D{x,y) = {x-\-y,x-y). 
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D defines an Gg-equivariant homcomorphism and thus we need to show that 

v{z)"'y^^ = 

Here, the action of Gq on Z C W (BW is the restriction of its action on M^ ® M^ 
while the action of r is given by t(w. u) — {v, —u). 
Now we cover Z ^ Ui U U2 where 

Ui = {iv,u)eZ:Q{v)^0} 

and 

^ U2 = {{v,u)eZ:Q{u)^0} 

We win show 'D{Ui)^'^'^ = 0, and the proof for U2 is analogous. This will finish 
the proof. 

Lemma 4.2. X>(C/i)^«^x = q 

Proof for non-archimedean F. Consider £1 : Ui —^ F — {0} defined as £i{v,u) = 
Q{v). By the localization principle, it is enough to show I?([/")-^Q''^ — where 
[/f = ^r^(a)> for any a e F - {0}. But 

C/f = {{v,u)\Q{v) = a,Q{u) = 4 - a,Q{v,u) = 0} 
Let M^" ~ {w e W\Q{w) = a} and let pi : U" -^ W" be given by ^1(1", u) — v. 
On W" our group acts transitively. Fix a vector vq e W" . 

Denote H{vq) := H(^q\ ^) and H{vo) := H(^q\ ^y 

^ "0 ^ "0 

The stabilizer in Hq oi vq is H{vo). The fiber pj"^(uo) = {a G VQ\Q{a) — 4 — a}. 
Frobenius reciprocity implies that 

p(C/^")S5,x ^ p(p-i(i,o))5(^o),x 

But clearly V{p^^{vq))^^''o^^^ = as -/d e H{vo). □ 

Proof for archimedean F. Now let us consider the archimedean case. Define U :— 
{{v,u) e Ui\u ^ 0}. Note that the map £i\{j is a submersion, so the same argu- 
ment as in the non-archimedean case shows that V{U)^'^-^ — 0. Let Y :— {{v € 
W\Q{v) = 4} X {0} be the complement to U in Ui. By theorem 13.21 it is enough 
to prove V{Y, Sym^{CN^^)Y^^^ = 0. 

Note that the action of Hq on Y is transitive, and fix a point (w, 0) G Y . The 
stabilizer in Hq of (w,0) is H{v), and the normal space to Y at (w,0) is v^. So 
Frobenius reciprocity (theorem 13. 4|1 implies that 

V{Y,Sym''{CN^'))"^^^ = Sym''{v^f '■'''> -'^ 
But clearly Sym'^iv-^)"^"^-'^ = as -/rf G i/(w). D 
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